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Abstract: We consider adaptive control problem in presence of nonlinear 
parametrization of uncertainties in the model. It is shown that despite traditional 
approaches require for domination in the control loop during adaptation, it is 
not often necessary to use such energy inefficient compensators it in wide range 
of applications. In particular, we show that recently introduced adaptive control 
algorithms in finite form which are applicable to monotonic parameterized systems 
can be extended to general smooth non-monotonic parametrization. These schemes 
do not require any damping or domination in control inputs. 
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1. INTRODUCTION 

The standard techniques to address nonlinear pa- 
rameterization of the uncertainty in adaptive con- 
trol literature involve applying domination func- 
tions (see, for instance, (Marino and Tomei, 1993; 
Lin and Qian, 2002a; Lin and Qian, 20026)) or 
damping of the unknown nonlinearity (Loh et 
ai, 1999). Both operate on the principle of invok- 
ing auxiliary crutches ensuring Lyapunov stabil- 
ity of the extended system. These methods yield 
effective analytical solutions to the problem of 
adaptation in presence of nonlinear parameterized 
uncertainties. 

Yet, in a wide range of applications in control and 
reverse bio- engineering, physics and biology, it is 
desirable to refrain from domination or damping. 
The issue of non-dominating adaptation is critical 
in control engineering applications where system- 
atic overshooting in control results in fast wearing 
off of the actuators, waste of energy and undesired 
chattering. A typical example is traction/braking 
control under unknown tire-road conditions. Tire- 



road conditions enter into the equations describ- 
ing the slip dynamics as uncertainties that are 
highly nonlinear in their parameters (Pacejka 
and Bakker, 1993; Canudas de Wit and Tsio- 
tras, 1999). The issue is how under these condi- 
tions the slip could be effectively controlled during 
braking without applying unnecessary large brak- 
ing/trackgin torques. 

In bio-engineering, the motivation to use non- 
conventional adaptation mechanisms is even more 
stronger. In these systems physiological consider- 
ations motivate local adaptation, at the level of 
the single node (Brenner et ai, 2000), (Webster 
et ai, 2002) (visual system, cognitive process- 
ing e.t.c). Even simplest mathematical models of 
these nodes usually are nonlinearly parameterized 
(Dayan and Abbott, 2001). Due to the necessity to 
respond sensitively to different stimulation, use of 
external domination is not desirable. On the other 
hand, because the number of interacting nodes is 
large, the adaptation, should be non-dominating 
in order to avoid inefficient consumption of energy. 



Prom control-theoretic prospective, perhaps, the 
most (iiallcnging task is to find the principles, 
which will allow to control behavior of nonlinear 
systems by gentle and non-dominating parametric 
adaptation. Available non-dominating solutions, 
however, are either local (Karsenti et al., 1996), or 
assume monotonic parametrization of uncertain- 
ties (Tyukin, 2003; Tyukin et al, 20036). There- 
fore, new approaches are needed in order to design 
adaptive algorithms capable of ensuring asymp- 
totic reaching of the control goal for large class of 
nonlinear parameterized systems 

Finding gentle solutions to control problems with 
nonlinear uncertainties will involve a change in de- 
sign methodology. Conventional design methods 
in adaptive control theory often favor Lyapunov- 
based methodology. For many decades Lyapunov 
methods were successfully applied in design and 
analysis of nonlinear and adaptive systems (see, 
for example, (Isidori, 1989; Sastry, 1999; Narendra 
and Annaswamy, 1989; Miroshnik et al., 1999)). 
Furthermore, as a rule of thumb, Lyapunov sta- 
bility serves as a measure of acceptable perfor- 
mance in mechanics and engineering simply for its 
formulation guaranteeing small deviations from 
the equilibrium in case of small perturbations in 
initial conditions. 

When adaptive control is required, however, devi- 
ations of the unknown parameters are likely to be 
large in order for the adaptation to make practical 
sense. Therefore, requirement of Lyapunov stabil- 
ity for systems with general parametrization does 
not seem to be necessary unless it provides certain 
advantages in specific applications in addition to 
mere asymptotic reaching of the control goal. 

On the other hand, adaptation processes in many 
physical and biological phenomena are far from 
being stable in conventional sense. Examples of 
such non-stable adaptation include (but are not 
limited to) high-frequency oscillation of the eye 
(tremor) that allows us to see static pictures 
better (Ditchburn and L., 1952; Martinez-Conde 
et al., 2004), perception of the ambiguous fig- 
ures (perceptual switches) (Ito et al., 2003), evo- 
lution in social and ecological systems (Sole et 
al, 1999; Bak and Sneppen, 1993). This moti- 
vates us to seek for replacement of conventional 
Lyapunov stability-based methodology for dealing 
with problems of adaptation in nonlinear systems. 

Doing so would enable, in principle, a specter 

of entirely new applications and associated prob- 
lems is emerging. Theoretical findings in physics 
and biology such as intermittent synchronization 
(Gauthier and C, 1996; Kaneko and Tsuda, 2000; 
Kaneko, 1994; Kaneko and Tsuda, 2003), home- 
ostasis in the living cells stability (see (Moreau 
and Sontag, 2003) and references therein) and, 
last but not least, self-organized criticality - phe- 



nomena often observed in the earthquakes (Bak 
et al, 2002), in the neuronal activity of the hu- 
man brain (Beggs and Plenz, 2003) which can be 
modeled by the arrays of phase oscillators with 
nonlinear driving (Corral et al, 1995) show the 
importance of systems on the boundary of stabil- 
ity. Understanding the principles of learning and 
adaptation in such systems could eventually bene- 
fit greatly from the principles of adaptive control. 

We start with brief analysis of design strategies for 
adaptive systems with nonlinear parametrization. 
We show that that certainty-equivalence adaptive 
control inevitably requires damping or domination 
functions to guarantee global stability in presence 
of general nonlinear parametrization. In order to 
avoid these difficulties we replace requirement of 
Lyapunov stability of the system with mere reach- 
ing a neighborhood of the goal manifold. After the 
new control goal is defined we analyze a class of 
nonlinear systems where uncertainties are given 
by one-dimensional nonlinear parameterized func- 
tion. For this class of systems we provide adaptive 
control algorithms capable of steering the system 
state to a small neighborhood of the target mani- 
fold. The control algorithm should not involve nei- 
ther domination function, nor should it require for 
additional damping unknown nonlinearity. After 
this step is accomplished we extend our approach 
to multidimensional parameterizations. 

Throughout the paper we will use the following 
notations. Symbol x(i,xo,to) denotes solution of 
a system of differential equations starting at the 
point xo at time instant to; symbol C" denotes the 
space of r times difFcrcntiable functions; symbol 
M stand for the space of reals; M+ defines non- 
negative real numbers, symbol Im denotes image 
of the map. We say that ly : K+ M. belongs 
to L2 iff L2{i^) = v'^{T)dT < 00. The value 
ll^^lb = 1/^2(1^) stands for the L2 norm of u{t). 
Function z/ : M_|_ R belongs to and Loo iff 
ioo(i^) = supj>o ||!^(t)|| < 00, where || ■ || is the 
Euclidean norm. The value of 11 
stands for the norm of i/(i). Symbol ^^(x) 
denotes the set of all x' : ||x-x'|| < e. Let X C M", 
distance dist(x, A') = infx'g^' llx — x'lj. Symbol 
Ue{X) denotes the set {x' e M"| x' : dist(x', X) < 
e}. Symbol Lfip stands for the Lie-derivative of 
function ip{x) w.r.t. the vector field f(x). 

The paper is organized as follows. Section 2 con- 
tain preliminary notations and statement of the 
problem. In Section 3 we provide main results of 
the paper. Section 4 concludes the paper. 



2. PROBLEM FORMULATION AND 
PRELIMINARIES 

Let us consider standard adaptive control problem 
where the uncertain system be given as follows 

X = f (x, e) + g(x)u, xo e f^x (1) 

where x e R" is state vector, f : R" x M'' ^ 
M", g : M" ^ M" arc Ci-smooth vector-fields, 
G C K'' is vector of parameters, u is 
control input, and fix C M" is the set of initial 
conditions xq. Functions f, g arc known, vector of 
parameters is assumed to be unknown a-priori. 
We also assume that g(x) is bounded w.r.t. x. 
Let the control goal be to reach asymptotically 
a neighborhood of the following manifold given 
implicitly by 

^(x) = 0, 7/^ e C2 (2) 
In addition to (2) we will require that 

V'(x(t)) e Loc. ^ At) e Loo (3) 

This requirement ensures that any bounded de- 
viation from the goal manifold does not result in 

unbounded growth of the norm ||x||. In addition 
we assume that |Lg(x)'(/;(x))| > (5^ > 0. 

Let us select the class of admissible control func- 
tions which, allowing for the goal to be reached, 
can compromise between performance and dom- 
ination issues. The most natural way would be 
to define this class on the ground of certainty- 
equivalence principle. In particular, consider con- 
trol function 

u(x,0) = (LgV(x))-H-if(x,^)^(x)- 
ip{iP)+v{t)) 

which transforms the system (1) into the following 
error model 

^ = /(x,0)-/(x,0)-^(V')+^7(t), (5) 

where /(x,0) = if (x, 6')V'(x), <^ G C C° : 
M ^ M and ^{i))tp > V V 7^ 0, f , d : R+ ^ 
R. The desired dynamics (performance) of the 
system is given by equation tj) = —(fi{'ip), and 
v{t) stands for auxiliary control or disturbances 
depending on the context. 

Definition 1. Adaptive control law (4) is called 
non- dominating in class Cip if for any e > 
there exists such function 0(x, t, 5{e)) G ^Ig, (5(e) : 
R+ R, and time t* that |f/'(x(t, xq, io))| < e for 
any t > t* , xq G fix, 9 G Q.e, f and v{t) = 0. 

In the present study we will restrict class to 
the following class of functions: 

C^(fc) = {(p:R^R| ^gC\ 

(p(V)V > i^'^k, fc G R+} ^ ' 

The fact that adaptation is non-dominating in this 
class of functions means that for any arbitrary 



(4) 



small gain > in feedback ip{tp) = ktl) there 
exists function 0(x, t, 5) such that control goal is 
reached in finite time. In order to specify desired 
performance of the adaptive algorithm itself we 
require that ^(x, t,(5) does not change along the 
manifold /(x, 6) - /(x, 0) = and norm \\d - d\\ 
does not grow with time. 

In conventional certainty-equivalence adaptive 
control the problem of adaptation is usually 
viewed as the problem of design of operator 
A{il), X, 0, t) such that solutions of 

= A(?A,x,^,i) (7) 

together with (4) ensure the goal relation (2). 
Function ^(■i/), x, 0, t), in addition, neither should 
depend on unknown 6, nor it should require 
derivative x. The standard way to solve this prob- 
lem for v{t) = is to design function A(^, x, 6, t) 
such that V'(x) = 0, = is stable manifold in 
Lyapunov sense. 

In general nonlinear setup this condition, however, 
is hardly ever met for every G fig and x(to) G 
R" . To show this it is enough to decompose system 
(l)-(7) into the following form 



+ (l)v{t), d = d-e 



(8) 



where functions i/)^, T{x,9,0), ^^(V',x, 0,t) fol- 
low from Hadamard lemma ^ . Unlike in linear 
parametrization case, explicit dependance of func- 
tion 6, 0) on unknown 6 does not allow to 
compensate for uncertainty by choosing appro- 
priate function ^^(^,x, 0,i) in (8). Therefore, 
in general, it is necessary to use additional con- 
trol input v{t) in order to ensure that system 
(8) is Lyapunov stable and that V(x) as 
t ^ 00. Success of this strategy is reported in 
(Loh et al, 1999), (Lin and Qian, 2002a), (Lin 
and Qian, 20026). 

One step forward towards obtaining non-dominating 

adaptive control would be to reformulate the 
problem as follows: design function d{yi,t) such 
that either 

lim /(x,0)-/(x,0(x,i))=O, (9) 

t—*oc 

or 

/(x,0)-/(x,0(x,t)) Gia (10) 
hold^. One possible way to achieve goal (9), 
(10) is to use information about the difference 



In particular, these fmietious ean be calculated as follows 



1 3f(x.A8-U-A)e) 

1 aA{x^,x,e,t) 



d\ ipili = /(J 



1 dip(\^) 
dXip 



^ Similar idea was proposed in (Ortega et al., 2002) as 
adaptive "root-searching" strategy 



/(x, 0) — /(x, §(x, t)) explicitly in the adaptation 
algorithm rather than using external control v{t). 
For a class of nonlinear parameterized systems 
this additional information can be introduced into 
adjustment schemes by mere structural changes in 
the adjustment law. In particular it is suggested 
in (Tyukin, 2003) to use adaptive algorithms in 
differential-integral or finite form instead of using 
adaptive algorithms in differential form. Extended 
system in this case can be described as follows: 



-^^ ^(x,6/,6>) 
-J^{x,e,d)a{x,t) 



(11) 



where ^(x, 6, 9)a{x, t) is positive semi-definite 
time-varying matrix. Sufficient conditions for ex- 
istence of such algorithms are given in (Tyukin et 
al., 2003 a), (Tyukin et ai, 2004), where the prob- 
lem is reduced to solution of specific partial differ- 
ential equation ( or explicit realizability condition) 
by embedding the system into the one of the 
higher order. While solution to this problem was 
shown to exist for wide range of functions a(x, t) 
and ip{x), it is not always possible to guarantee 
that J^{'x.,6,9)a{x,t) is positive semi-definite for 
arbitrary /(x, d) and any G e i^e, x(to) € K". As 
a result of that Lyapunov stability of the whole 
system becomes problematic, if not at all impos- 
sible, for general nonlinear parameterizations. 

These observations suggest that in both conven- 
tional problem statement (5), (7) and nonconven- 
tional ones (8), (11) ensuring Lyapunov stability 
for adaptive control system in case of nonlinear 
parametrization inevitably leads either to domi- 
nation of the nonlinearity or to additional restric- 
tions on the class of nonlinear parameterizations. 
In the other words, the problem of Lyapunov 
stable and non-dominating adaptive control is ill- 
posed in general. As a candidate for replacement 
of Lyapunov stability one could think of the set at- 
tractivity (Guckcnhcimer and Holmes, 2002; Mil- 
nor, 1985) of the goal manifold. This concept al- 
lows us to design systems which being unstable in 
Lyapunov sense have bounded solutions and also 
are capable of reaching the goal asymptotically. 
The main problem with this concept, however, 
is that there is a number of conditions to check 
which critically depend on precise knowledge of 
the vector fields of adaptive system. This knowl- 
edge inc;ludes in particular properties of yet un- 
known function 0{x,t,S). 

Therefore perhaps the most reasonable and the 
least demanding concept of the control goals 
would be the notion of oj-limit set 

Definition 2. A point p e M" is called an w-limit 

point a)(x(t, xq, io)) of xq G M" if there exists 
sequence {ti}, ti — > oo, such that x(i, Xq, to) — > p. 



The set of all limit points u!{x{t,xo,to)) is the w- 
limit set of xq. 

Let, therefore, the control goal be to ensure that 
for some positive e the set 

nV;(e) = {xeM"|x: |V(x)| <e} (12) 

contains the uj-limit set of f2x for non-autonomous 
system (1), (4) with v{t) = 0. Hence, the main 
question of our current study is the following: is 
there exists a non-dominating adaptive scheme 
and reasonably large class of parameterizations 
of the uncertainty such that all 0^(e) contains 
the w-limit set of the adaptive system for any 
arbitrary small e > 0, all trajectories of the 
system are bounded, and volume of the domain of 
uncertainty is decreasing with time? The answer 
to this question is provided in the next section. 



3. MAIN RESULTS 

To begin with, let us consider the case where 
function /(•,•) is parameterized by scalar 9 € 
Vie = [Q.A dW, e_ <9. For each 6 & ^.0 and 
nonnegative A G M>o we introduce the following 
equivalence relation 

9^9'^ |/(x,6»)-/(x,6i')| < A VxgR" 

and corresponding equivalence classes [^]a = 
{9' e ng\9^9'}. 

For the given functions (/?(^) and a{t) : R+ M, 
a{t) e let us define the following function 



Ss{^{i;),a{t)) 



1, \^{i>)+a{t)\>5 
0, \^{i^)+a{t)\<5 



With the function Ss(ip{'il){x{t))),a{t)) we asso- 
ciate the time sequence T = ig < < < < 
■ ■ ■ <ti <ti < ti+i < U+i < • • • , where 



to 



ti = inf {t : |(^(V(x(t))) + a{t)\ < 5} 

t,= inf {t: \^{i,{x{t)))+a{t)\>5} 

t>ti-i 



(13) 



The elements of this sequence are time instances t^ 
(or ti) at which the sum (p(V'(x(t))) -I- a{t) leaves 
(or enters) domain \ip{ip{x{t))) + a{t)\ < 5. We 
define that = to if \(p{ip{x{to))) + a{to)\ < 6. 
Let us, in addition, introduce function A with the 
following properties: 

^ [0,0], A e C\ Im{X) D \9,9] 



V s e M, 6* e r^e 3 T, r(s) > : 
9 = X{s + t{s)), 0<t{s) <T 

An example of such function is 

X{s)=9 + 9^{sm{s) + l) 



(14) 



As a candidate for ^(x, t, 6) we choose the fohow- 
ing adaptation algorithm: 

^o(x, t,S)=j (^p(x, t) + ei{t) + Ce{t)) 
^P(x,f) = V(x) (a(i) + ^V(x) 



V'(x)(6+&iV'(x))) 

1 

6i 7^ 0, ai,a2 < 



6V 



(15) 



Properties of algorithm (15) are summarized in 
the following theorem: 

Theorem 3. Let system (1) with control function 
(4) and corresponding error model (5) be given. 
Let function v{t),v{t) G L^o and ||w(t)||oo < A. 
Let in addition function /(x, 6) be bounded. Then 

1) for any e > and </? € C^(A;), fc > there exist 
fimctions 5o : R+ ^ M+, (5o e C°, 5{Q) = 0, 
5{e, A) = 5o(£) + A, and function 6'(x, t, 5), given 
by (15) with arbitrary 7 e R, 7 > and initial 
conditions such that f2^(£ + ■§■) contains the w- 
limit set of system (1); 

2) all trajectories of the system are bounded and 
solutions x(t,xo,to) converge into the domain 

T^^^ finite time; 

3) if for any & there exist constants Ti > 0, 
M > 2(5o(e) + A > and function r(t) : K 
(0,Ti) such that 



(16) 



|/(x(t + Tit)),e) - /(x(< + T{t)), e)\>M 

then converges into h{e{[0]) in finite time. 
Proof of the Theorems are given in Appendix. 



Theorem 3 states that for arbitrary C'^ -smooth 
and bounded function /(x, 9) there exists non- 
dominating adaptation algorithm in class C^{k). 
To sec this it is enough to let A = 0. In presence 
of the unknown perturbation v{t) we guarantee 
convergence of the trajectories x{t, xq, to) to arbi- 
trary small neighborhood of f2^(^) subject to the 
choice of Sq > 0. 

Adaptation algorithm (15) ensures boundedness 
of the solutions in the extended system and fur- 
thermore, under assumption (16), it guarantees 
convergence of the estimates 9 to arbitrary small 



neighborhood Ue{[9]A) of the equivalence class 
(set) [^]a- In case [9] a = {9} it guarantees con- 
vergence to the small neighborhood of the actual 
value of 9. 

Condition (16), which we require for convergence 
of the parameter 9 into U^, can be regarded as 
a new version of nonlinear persistent excitation 
(Cao et al, 2003). Our condition, however, is 
more easy to verify. In addition, this condition is 
consistent with linear persistent excitation condi- 
tion (Narendra and Annaswamy, 1989): 3 T > 
0, p > : //+'^x(r)x(T)'^dT > Indeed 

//+^x(T)x(r)^dT > pin ^\fd^e' (0- e'Yx 

/;+^x(r)x(r)^dr(0-0')>Pl|e-e'lP 

d'f^{t^)\ > ^e-e'i t, e [t,t + T] 

e'yyi{ti)\ >M,\f9e ng\U„ M=f 

Let us generalize the statements of Theorem 3 to 
the case where 6 E fig C M."^ . For that reason we 
introduce the following assumption: 

Assumption 1. Let ilg be bounded and there exist 
C^-smooth function rj : [9_, 9] such that 

that for any d € 0.0 there exists A*(0) e \9,9]: 
|/(x,0)-/(x,r7(A*)| < A, VxGM" 



1(0- 
1(0- 



Applicability of algorithms (15) to multi-dimensional 
6 then follows explicitly from Theorem 3. 

Theorem 4- Let system (1) with control function 
(4) and corresponding error model (5) be given, 
function /(x, 9) be bounded, and Assumption 1 
hold. Then statements 1) - 3) of Theorem 3 follow. 

Adaptation algorithm (15) can be considered as 
a nonlinear dynamical system which, however, is 
not internally globally stable in Lyapunov sense. 
The algorithm, nonetheless, does not lead to un- 
bounded growth of its internal state, neither it 
fails to ensure reaching of the control goal for 
arbitrary initial conditions x(fo), 61 (to), ^{to)- 
The properties of this algorithm essentially rely 
on two ideas: monotonic evolution of 9o{t), and 
multiple equilibriums in the corresponding differ- 
ential equation for 9o given by (17) in Appendix. 

Multiple equilibriums of are guaranteed by func- 
tion A(-) defined by (14) and invariance of 9Q{t) 
on the following set {x, x, ^0 '■ /(x, ^^) — 
/(x, A(0o)) = 0}. Monotonic character of 9Q{t) 
and multiple equilibriums ensure existence of the 
limit limt_>oo ^o(t) = ^0,00 for any initial con- 
ditions x(fo), 9j{tQ), ^{to). This fact is used in 
the proof of Theorem 3 to show convergence of 
the trajectories x(t,xo,to) to the set specified by 
(12). Notice also that existence of these multiple 
equilibriums in case of persistent excitation for 



a 




Fig. 1. Adaptation with multiple equivalent equi- 
libriums (plot a) vs. adaptation with single 
asymptotically stable equilibrium (plot b) 



i1o(^) 




Fig. 2. Trajectory ri{X) (the bottom panel) as 
projection of the smooth curve. Gray circles 
form the gird in the parameters space which 
induces the curves satisfying Assumption 1. 

v{t) = ensure that the set We([0]) becomes 
globally attractive w.r.t. function 9{t,x,S). 

Conceptual difference between our method and 
conventional Lyapunov-based design is illustrated 
with Fig. 1. In Fig. 1 the upper plot depicts 
the solution curve 9o{t,9o{to),to) of differential 
equation (17), were the arrows point towards 
increase of the independent variable along the 
curve. For the given value of 9 and initial condition 



9o{to) function X{9q) generates infinitely many 
equilibria ^o,i, « £ N. If the perturbation is apphed 
to the system the system will eventually escape 
its current equilibrium (for instance, 6*0 = ^o,i) 
equilibrium and move along the axis 9q. Due to 
the monotonicity of 9o{t, 9o{to), t) with respect to 
t it eventually reaches a neighborhood of the point 
^0 = ^0,2 and stops there if the perturbation is 
released. In order to prevent unbounded growth 
of 9o under persistent perturbations it may be 
necessary to change the sign of 7 in (17) upon 
solution 9o{t) reaches certain bounds. 

In the lower plot we have shown the typical would 
be solution curves of Lyapunov asymptotic stable 
estimator. Disturbances will move the solution 
away from the equilibrium and the system will 
restore its original state after the disturbing terms 
vanish. Despite obvious advantages of this type 
of behavior, i.e. small perturbations induce small 
deviations, in adaptive control problems the para- 
metric perturbations are usually large. Further- 
more, as it has been already pointed out, gentle 
control ensuring Lyapunov stability for arbitrary 
nonlinear parameterized system is problematic. 

One of the distinctive features of algorithms (15) 
is that they can in principle take into account 
information about (available a-priori) distribution 
of the unknown quasi-stationary as a function 
of time. This information is then to be accounted 
for by the choice of functions r]{-) and A(-). Illus- 
tration to this choice is given in Figure 2. In Fig. 2 
the curve J7(A) is designed to visit neighborhood of 
the center more frequently (16 times per period) 
than other points (only 2 times per period) of the 
domain. Despite the problem of choosing these 
curves r]{X) (which fit given distributions of 6) 
is not trivial, such optimal choice, if successful, 
can provide room for further enhancements of 
performance in the adaptive systems. The second 
step would be to adjust or tune functions r]{X) 
adaptively thus enabling self-tuning of the adap- 
tive algorithm itself. These topics, however, are 
beyond the goals of our current study. 



4. CONCLUSION 

In this paper we have proposed new technique for 
adaptive control of nonlinear dynamical systems 
with nonlinear paramctrization. In contrast to 
conventional concept of Lyapunov stable adaptive 
control, and as a result domination of the nonlin- 
earity by high-gain feedbacks, we use adaptation 
schemes which are not stable in Lyaponov sense. 
Yet, these algorithms guarantee reaching of ar- 
bitrary small neighborhood of the desired target 
set. Moreover the resulting control function is non- 
dominating. 



The ideology beyond our method is somewhat 
similar to the one introduced in (Ilchman, 1997; 
Pomet, 1992). The results, however, are substan- 
tially different. First, we do not require neither 
exponential stability nor asymptotic stability of 
the target dynamics. Second, the speed of adap- 
tation in our case is not to be slowed down with 
time. Last but not least is that the method can 
be used to identify nonlinear systems of rather 
general class without requesting for linearization 
of the nonlinear ities. 

Technique for adaptive control introduced in our 
paper rather well coincides with the thesis of 
"nonlinear philosophy for nonlinear systems" de- 
clared in (Fradkov, 2000). Furthermore, it fits 
well empirical observations that complex natural 
systems poses clearly detectable patterns of insta- 
bility in the empirical data. 

Despite we proved only that the target set will 
be reached in the system with our algorithms, we 
hope that some type of robustness w.r.t. unknown 
external perturbations can be also shown. In fact, 
robustness of the system to unmodeled dynamics 
with known L^o norm can be easily ensured by en- 
larging the value of S in our algorithms. Whether 
or not robust behavior can be achieved by choice 
of another parameters like functions r]{-) or A(-) 
will be the topics of our future study. 
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5. APPENDIX 

Proof of Theorem 3. Let us consider system (15) 

and calculate derivative 6q with respect to inde- 
pendent variable t: 



% = -fSsi^P, a{t)){^{i;) + ^)(^(V') + a{t)), 
9o{to) € M 



(17) 



To proceed further we will need auxiliary Lemma 
5 and Lemma 6. 

Lemma 5. Consider system (1), (5). Let func- 
tion /(x, 0) in (5) be bounded w.r.t. x, and 

v{t),v{t) e Lcx>- Then e{t),e{t) G L^ imply that 
i> e Lao- 
Proof of Lemma 5. First, we observe that V(x) G 
Lao- This follows immediately from boundedness 
of /(x, 6) and the fact that function tp belongs 
to the class specified by (6). Therefore, ac- 
cording to assumption (3) on fimction -(/-"(x), state 
X G Loo. Moreover, given that tjj G Loo and 
1^ G C^, we can derive from (5) that t/j G Loo- Let 

us consider = - (f(x,0) + 



g(x)u) + + + v{t). Derivatives 

9/^£2^ df{^,0) continuous functions with re- 
ox ' 9x 

spect to X as V' G C^, f (x, 6) e C^. Therefore they 
are bounded as x,6,6 G Loo. In addition, conti- 
nuity of ^'^g^'^^ and 1^ results in their bounded- 
ness. To conclude the proof it is enough to notice 
that function u is bounded for bounded x, 9. The 
lemma is proven. 

Lemma 6. Let function 'ijj{t) be given and its 
second time-derivative is bounded: IV^I < (3i, (3i > 
0. Then there exists differential filter 



iWa 

y = (ci, o)(ei, 6)' 



bi 



(18) 



where hi ^ 0, ai,a2 < 0, and time > such 
that for any positive constant e > the following 
estimate holds: \y{t) — i^{t)\ < e V t > ti. In 
particular, if ci6i = —a\, 62 = 02^1 then filter 
output satisfies the following inequality: 



\y{t)-m\<\^\ + 5{t), 



ai 



(19) 



where 5{t) decays exponentially fast to the origin. 

Proof of Lemma 6. Let 62 = 0261- Then system 
(18) has the following equivalent representation: 



1 

ai 02 



(20) 



V = {ci 0)(Ci, 6) 



Denoting 



1 

ai 02 



bi 



we may write the filter equations in a vector- 
matrix form: 



Consider output y of system (21): 



(21) 



y 



e-'^^biV'(T)dr ) . (22) 



Matrix A is Hurwitz and, therefore, invertible. 
Hence taking into account existence of ip{t) 
and that matrices A^^, e^* commute, we can 
rewrite equality (22) as foUows: y = c'^{eA'^^Q — 
e^*A-^e-^'hii;{t)\'o+e^'A'^ e''^-'hii,{T)dT). 
Hence y = c'^{e'^*^o-A-^hiip{t)+A-^e'^*hiip{0)+ 
e'^(*^'^^biV;(T)c?r). Consider the following 
difference \y{t) — ^/j{t)\: 

\y{t) - 4,{t)\ = |c^(e^*Co - A-^hMt) + ^"^ x 

e^*biV'(0) + A-^ [ e^(*-^)biV;(T)dT) - V'(i)l 

< |c^(e^*^o - A-^hiip{t) + A-ie^*bi^(0)) 

-V3(t)| + |c^A-i / e^('-^)bi/3idT| 
Jo 

= |c^(e^*€o - A-^hii^it) + A-^e^'hiij{0)) 
- iij{t)\ + \c^A-^e^%il3i - c^A-^hifh\, 

where = A'^A^'-. Let us denote 6{t) = 

|c^e^*^ol + |c^A-ie^*biV>(0)| + \c^A-^e^*Pi\. 
Term 5{t) ^ at i cxd as matrix A is Hurwitz. 
Therefore for any > there exists time ti > 
such that for any t > ti the following inequality 
holds: 

\y{t)-m\ < \{c^A-'h, + mt)\+ 
|(c^A-2bi/3i| 

Let us consider term c^A^^hi in (23). Matrix 
A-' = 



(23) 



1 

ai 02 



1 ( -«2 1 



Then 



c'^A-^bi = (ci 0)A-i 



bi 



tti 



Notice that — —1 due to the lemma as- 

ai 

sumptions. Therefore, using inequality (23) we 
can derive the following estimate: 

\y{t)-m\<\{c^A-^h,(3,\ + 6,, 

where 



A-^ = 

Hence 

\y{t)-m\ < 

,02/31 



1 / 02 + ai —02 
-0201 

(ci 0)A-2('M/?i 



Oi 



^1+^1. 



(24) 



Inequality (24) proves Lemma 6. 

Lemmas 5,6 will allow us to show that 9{x,t,d), 
S = 6o + A, So S M+ has a limit as t — >■ 



oo. First we observe that d{x,t,6) is bounded. 
Moreover 0(x, t, 6) is continuous and has bounded 
time-derivative. Therefore, according to Lemma 5 
derivative tp is bounded. Therefore, as it follows 
from Lemma 6, there exist parameters oi, 02, 6i, 62 
of filter (20) such that \a{t)-^{t)\ < So/4:+\Si{t)\, 
where di{t) ^ as t ^ 00. In particular, there 
exist time ti > such that \Si{t)\ < So/ 4: for 
any t > ti. Notice, that function 9o{x,t,S) is 
bounded for t < t\ (as a sum and integral of 
bounded functions in time). Let us show that for 
any t > ti function 6'o(x, t, (5) is monotonically 
increasing with respect to time t. 

Let us consider function a{t), t > t\. Taking into 
account that \a{t) — ip{t)\ < So/2 for any t> tiwe 
can estimate function a{t) in the following way: 

a(t)=V'(<)+MW, W)\ <So/2 (25) 

Therefore, for any a{t),tl): \{a{t) -|-<^(V'))| > ^ we 
have 

{i> + fW){ait) + ^{^P)) = (a + ^(V')- 

Mi))(a(t)+^(^)) = (a(t) + <^(V))'- 
f,{t){a{t) + > \{a{t) + ipimS- (26) 

||(a(t) + ^(^))|>|>0 

Hence, according to equations (17), (26) we can 
conclude that function 6o{t,x,S) is monotonic, 
continuous and not decreasing with time. 

Let us show that, function 6o{x,t,S) is also 
bounded from above. Assume that for any Dq > 
there exists t2 > such that 

\eo{yi{ti),tuS) - eo{^{t2),t2,S)\ > De (27) 

Let us select Dg > T, where the values of T 
are specified in (14). Function 9q{x{t),t,S) is 
continuous w.r.t. r and bounded for any r G 
[ii, f2](boundedness of 6'o(x(r), r, (5) follows from 
boundedness of its derivative over finite time 
interval). Therefore, according to the intermediate 
value theorem, for any Q < Tq < Dq there 
exists tz € [^1,^2] such that 6'o(x(f3), ^3, (5) = 
6o{x(t\),ti,S) +To. Taking into account (14) we 
can conclude that for any 6 E [9, 9] there exists 
<3 > such that 9 = X{9o{x{t3),t3,S)), ts € 
[ti , ■ According to the properties of function 

6o{x,t,S), however, derivative Oo{t) = for any 

t >t3 as 

\ait3) + ^(V'(x(i3)))| = IV- + ^(^(x(t3))) + ^l{t3)\ 
= |/(x, X{9o{x{h), h, S)) - /(x, 9)) + v{h) + 
^(^3)1 < \v{t)\ + Ht)\ < Sa/2 + A<Syt>t3 

Therefore 9o{x{t2),t2, S) = 9o{x{t3),t3,S) < 
Oo{x{ti),ti,S) + T which contradicts to (27). 

So far we have shown that do{x{t),t,S) is con- 
tinuous, monotonic and bounded function for any 
t > t\. Therefore, applying Bolzano- Weierstrass, 



theorem we can derive that there exists the fol- 
lowing limit 

lim ^o(x(t),t,^) =^o,cx> (28) 

r— ^oo 

Taking into account equality (17) we can rewrite 
function 6o{x{t), t, 6) for t > ti as follows: 

[ 55(vp(V(T)),a(r))(Vi(T)+vp(V(T)))x (29) 
Jti 

((^(V'(r)) + a(r))rfr 

Equations (29), (28) and inequality (26) result 
in the following estimate < Ss{(p{iP{t)), 

a(T))f dr = T,Zo(U - ti)^ _< oo- The last 
inequality implies that limj^oo U — ti = 0. Let 
us consider \(p{tp{t)) + a{t)\ for t G 

\ip{m) + a{t)\ < \ipmi)) + aiU)\ + {U-U)D\.i, 

where £>|.| = max^^^^^ j.j ^|<^(^(t)) + a{t)\. Func- 
tion is the bounded function of time and 
therefore 

lim sup Ifii^it)) +a{t)\=S (30) 

t^oo 

Taking (30) into account we can derive that dy- 
namics of function ^(t) for t > ti can be described 
as follows: 

ip = n{t) - fiip), lim sup \n{t)\ < -^^0+ 

3 ^ (31) 

5=-So + A 

According to the definition of lim sup there exists 
a time instant t4 such that \iJ.{t)\ < 2So + A for 
any t> ti. Let us consider the following function 

Jo 

<l>{^,y)={ 0, -v<(,<v,v>Q 

where ij){t) is the solution of system (31) for 
t > ti with initial condition 4'{ti). Function 
<^(V') G C^{k), therefore v'(V')V' > ^V'^- Let us 
select u = {25q + A)/k and consider derivative V: 

i/ = <^(Vaj^)^ = </'(V',^)(a^(<)-v(V')) 

< <p{ib,v){ji{f) - kiP) < 0. 

Moreover, it follows from Barbalat's lemma that 
0(^, v) — > as f ^ 00. This automatically 

implies that there exist time instant such that 
||^(x(t))||oo < (3<5o + A)/fc for any t > t^. 

So far we have shown that for any 5 > A + 6o, 
So > 0, 'P & Ccp{k) and xq G fix there exists 
algorithm (15) with arbitrary 7 > and initial 
conditions such that f2^(2Jo/fe + A/k) contains 
the w-limit set of system (1), (4) with v{t) : 
II ''^(^) II 00 < A. Furthermore, we have shown that 
trajectories x(t,Xo,to) converge into the domain 



^^i/>(3(5o/fc + A/fc) in finite time. Therefore in order 
to complete the proof, given arbitrary £ > 0, it is 
enough to pick So < l/3ke. Hence, statements 1 
and 2 of the theorem are proven. 

Let us show that statement 3 of the theorem holds. 
Notice that, in order to complete the proof it is 
enough to show that A(^o,oo) G i^e{[0]A), where 
^0,00 is defined as in (28). Let us assume that 
X{6Q{x,ti,S)) does not belong to i/e([^]A), and 
consider equality (25) for t > ti. According to 
(25) the following equality holds: 

^ + ifi^) + ii{t) - a(t) + ^{xP) = /(x, 9) - /(x, 9) 
+ v{t)+tx{t), Ht)+v\ < y +A 

Function A(6'o(x, ti, S)) docs not belong toU^{[9]^), 
therefore there exists T{t) such that |/(x(i + 
T{t),9) - f{x{t + T{t)),9)\ > 2So + A, and, con- 
sequently \a{t + T{t)) + ip{iix{t + T{t))))\ > So + 
So/2 + A, t + T{t) > ti. Let us denote te = t + 
T{t). Notice that a{t),d(p{tp{{x{t)))/diptp € L^. 
Hence, there exist constant ri > such that 
\ipitp{t)) + a{t)\ >S = So + A for any t € [te, te + 
Ti]. Furthermore, function ^o(x, t, 5) is monotonic 
and, according to (26), (16) increases by at least 
NtiS'^/2 over time interval [ti,t],t > ti + NTi un- 
til X{()o{t)) e Ue{[9]A)- On the over hand, we have 
shown that function 6o{x:,t,S) is bounded from 
above and, furthermore, converges to the limit 
^0,00 < 00. Therefore, there exists time instant 
tr, ti < tr < 00 such that A(^o(x, t, S)) € Ue{[0]A) 
for any t> tj. 

Let us assume that A(6'o(x, ti, (5)) 6 Ue{[9]A)- 
Then there are two possibilities. First, A(^o(x, t, 5)) 
G Uf_{[9]\) for all t > t\, and second, A(^o(x, t, 5)) 
eventually leaves the domain We([0]A)- In this 
case, however, the previously provided arguments 
apply. The theorem is proven. 

Proof of Theorem 4- Let us denote v{t) = 
f{x{t),0) — f{x{t),r]{9)). According to Assump- 
tion 1 function v(i) G L^o and moreover ||i'(t)||oo = 
A. Then x is bounded. Hence, applying the same 
arguments as in the proof of Theorem 3 we con- 
clude that 9, 9 are bounded. Therefore, v{t) G Loo- 
Then Theorem 3 applies, which proves the theo- 
rem. 



